Set Up the Amazon S3 Connector

The Amazon S3 Connector allows you to ingest documents from your Amazon S3 storage directly into your project.

Prerequisites

  • An AWS account with access to the Amazon S3 bucket you wish to ingest.
  • Your Amazon S3 Access Key, Access Secret, and Bucket Name. You can find these details within your AWS account.

Steps

  1. Select Amazon S3 Data Source Navigate to the Data Sources section of your project. Click Add data source and select Amazon S3 from the available library.
  2. Provide Connection Details Fill in the required details to connect to your S3 storage:
    • Access Key: Your AWS access key.
    • Access Secret: Your AWS secret access key.
    • Bucket Name: The name of the S3 bucket you want to ingest from.
Double-check your Access Key, Access Secret, and Bucket Name for any typographical errors.
  1. Monitor Ingestion Status Once you provide your connection details, the page will refresh to display the ingestion status. You can view the current ingestion status by clicking on the data source again. The detailed list will show all ingested files.

Next Steps

After your data has been successfully ingested, the Amazon S3 data source is ready to be used with an Agent.